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Abstract 


This report describes the on-going development, testing, validation and implementation 
of a Records Quality Index (RQI) by Structured Decisions Corporation (SDC). The 
purpose of the RQI is to measure the performance of criminal history records systems and 
to assist the Bureau of Justice Statistics (BJS) to (i) assess the status of records quality at 
both the state and national levels; (ii) identify critical records improvement activities by 
pinpointing areas of deficiency; and (iii) target specific state- and local-level problems 
and deficiencies in future National Criminal History Improvement Program (NCHIP) 
funding cycles. 
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Highlights 


This report describes the on-going development, testing, validation and implementation of a 
Records Quality Index (RQI) by Structured Decisions Corporation (SDC). The purpose of 
the RQI is to measure the performance of criminal history records systems and to assist the 
Bureau of Justice Statistics (BJS) to (i) assess the status of records quality at both the state 
and national levels; (ii) identify critical records improvement activities by pinpointing areas 
of deficiency; and (iii) target specific state- and local-level problems and deficiencies in 
future National Criminal History Improvement Program (NCHIP) funding cycles. The work 
is funded by the Bureau of Justice Statistics, U.S. Department of Justice. 


e Based on analysis of the first nationwide data collection cycle, and in cooperation 
with the states’ criminal history record repositories, a Records Quality Index (RQJ) 
has been developed and refined. The RQI has been shown to be an effective gauge of 
the performance of state criminal history records systems. Comprised of a set of 
well-defined outcome and process measures, the RQI reflects goals of the federal 
records improvement programs, and describes the progress with which these goals are 
being achieved. 


e The computed state RQI cannot be less than zero and has no upper limit. For 1993, 
the RQI ranged from 0 to 234 (with a median of 35.4); for 1997, the RQI ranged from 
0 to 338 (with a median of 112.2); and for 2001, the RQI ranged from 8 to 785 (with 
a median of 178.6). With few exceptions — due primarily to large arrest fingerprint 
card and/or disposition backlogs at the repository — the state RQIs increased over 
time. 


e From 1993 to 1997, the median percent RQI increase was 78.5%; from 1997 to 2001, 
the median percent RQI increase was 77%. 


e Of course, states with an RQI of zero have considerable room for improvement. It is 
noteworthy that in 1993 there were eleven such states, whereas in 1997 there were 
only two and in 2001 there was none. 


e The National Records Quality Index (NRQI) — comprised of a weighted average of 
state RQIs — increased from 56.2 in 1993 to 202.0 in 2001. This is a direct result of 
increases in the individual state RQIs brought about by federally-funded 
improvements to state criminal history records systems. 


What is the RQI? 


Development of the RQI is part of BJS’s ongoing efforts to measure improvements in 
criminal records occurring as a consequence of federal funds awarded to states under the 
NCHIP’ and the Five Percent Set-Aside of the Edward Byrne Memorial State and Local Law 
Enforcement Assistance Grant Program’. 


' NCHIP implements the grant provisions of: the Crime Identification Technology Act of 1998; the Brady 
Handgun Violence Prevention Act; the National Child Protection Act of 1993; certain provisions of the 
Omnibus Crime Control and Safe Streets Act of 1968 and the Violent Crime Control and Law Enforcement Act 
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Much as the Dow Jones Index of 30 bell-weather stocks gauges the performance of the entire 
stock market, a criminal history records quality index — based on a small set of key measures 
— characterizes the performance of a large-scale criminal history records system. At the 
request of BJS, SDC — national evaluators of the federally-funded criminal history records 
improvement programs — developed the RQI to enhance BJS’s ability to monitor system 
performance across jurisdictions and over time and to help identify areas for improvement in 
future years. 


BJS is using the RQI as a barometer of performance to (i) assess the status of records quality 
at both the state and national levels; (ii) identify critical records improvement activities by 
pinpointing areas of deficiency; and (iii) help BJS target problems and deficiencies in future 
NCHIP funding cycles. The President’s Budget for 2004 included the RQI as a key 
performance measure for tracking state records improvements and targeting federal funding 
more effectively. 


How was the RQI developed? 
Development of the RQI required consideration of three things: 
(1) Criteria for including measures in the index; 
(2) The relative quality of the individual measures that would comprise the index; and, 


(3) The connection of the chosen measures to the common performance goals of federal 
criminal history record improvement programs. 


The first step, then, in developing the RQI was to identify a set of relevant criteria. These 
criteria in turn helped identify a manageable set of primary indicators for assessing the 
performance of criminal history records systems from which the RQI’s mathematical 
structure was evolved. The criteria included: 


C1. The individual measures which constitute the state RQIs must address the common 
goals of federal criminal history records improvement programs and their respective 
underlying legislative mandates (Exhibit 1). 


C2. To the extent possible, these individual measures should possess desirable data 
quality or measure attributes (Exhibit 2). 


C3. Since it is not practical to formally carry out a major evaluation or assess a large 
number of measures on a continual basis, a small set of key measures which can 
characterize the overall performance of the system must be identified; further, their 
combination into an index could be employed to continuously ascertain the 
performance of the system. 


of 1994; relevant requirements of the Jacob Wetterling Crimes Against Children and Sexually Violent Offender 
Registration Act, Megan’s Law and the Pam Lychner Sexual Offender Tracking and Identification Act of 1996; 
and the Victims of Trafficking and Violence Protection Act of 2000. 

* The Byme Formula Grant Program was created by the Anti-Drug Abuse Act of 1988. The Crime Control Act 
of 1990 required that states spend at least 5% of their annual Byrne formula grant funds on improving the 
quality of their criminal history records. According to the Bureau of Justice Assistance (BJA), the Justice 
Assistance Grant (JAG) Program, which waives the 5% set-aside, has received Congressional approval. 
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To cover the broad spectrum of data quality issues embraced by the six common 
goals, it is necessary to employ both basic and derived measures; derived measures 
(e.g., averages, percentages) are those that combine two or more basic measures. It is 
critical that all derived measures start from their constituent basic measures and be 
derived as part of the RQI development process. In other words, only the raw data 
required to compute the basic measures should be requested from the states. 


To the extent feasible, the individual measures which constitute the state RQIs should 
be chosen to facilitate their annual collection, so as to establish a time series for 
determining changes in the RQI since the advent of the federally-funded records 
improvement programs in the early 1990s. 


Like other national indices (e.g., Dow Jones, Consumer Prices, FBI’s Uniform Crime 
Reports, etc.), the RQI should be bounded below (by zero) but should not have an 
upper bound; that is, the index should be one that can grow indefinitely with no 
maximum value or saturation point — otherwise, the component parts of the RQI 
would remain fixed and no new quality improvement programs could become part of 
the RQI measurement process. 


Indeed, in order to make the RQI an updatable and continuous index, it is critical that 
as new outcome or process measures are included in the RQI, they do not cause 
discontinuities in the computed RQI values. 


Exhibit 1 Common Goals of Federally-Funded Records Improvement 


Federal Records Improvement Focus 


Provide Required Resources — Provide resources required to establish 
the necessary infrastructure for improving criminal history records and 
related systems 

Improve Records Quality — Improve the quality (i.e., the completeness, 
accuracy, timeliness and accessibility) of criminal history records. 


Improve Reporting — Improve interstate, intra-state and federal criminal 
history records-related reporting. 

Automate Systems — Automate systems for creating, storing, and sharing 
criminal history records. 

Identify Ineligible Firearm Purchasers — Identify persons ineligible, for 
criminal and non-criminal justice reasons, to purchase firearms. 

Identify Disqualified Care Providers and Other Applicants — Identify 
individuals disqualified from caring for children, elderly and disabled; 
identify persons ineligible for other sensitive positions or permits. 
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Exhibit 2 Desirable Attributes of RQI Measures 


Attribute Impact on Measures 


1. Understandability Are the pertinent measures well-defined and specific? Are they easy-to-interpret 
and hard-to-dispute? 


2. Measurability Are the measures, in fact, measurable? Can they be quantified ? 
3. Availability Are the pertinent measures available ? Are they easy to obtain? 
4. Consistency Are the states consistent in the way they define a particular measure? (For 


example, the percentage of arrests within the past 5 years that have dispositions 
recorded is interpreted conservatively — i.e., charge-based — in some states, while 
liberally —i.e., arrest-based — in other states.) 


5. Validity Are the measures sufficiently grounded to be deemed valid? Are basic measures 
in the form of raw data used to derive more complex measures? (For example, 
are the number of felony arrest cases disposed and the number of disposed felony 
arrest cases received by the repository used to determine the percentage of 
disposed felony arrest cases received by the repository?) 


6. Reliability Are the measures obtained in one period or setting statistically the same as those 
obtained in another period or setting? 


7. Stability Are measures derived from two or more other measures (e.g., percentages, 
averages) subject to instability (i.e., a change in the derived measure cannot be 
explicitly attributed)? (For example, an increase in the percentage of statewide 
felony arrests reported to the repository could be due to an increase in the 
number reported or a decrease in the number of arrests.) 


8. Accuracy Are the reported statistics accurate — have they been checked, double-checked, 
or perhaps even triple-checked? 


9. Independence Is comparative assessment of state data quality improvements based upon 
independent measures? (For example, the lack of fingerprint support for arrest 
records and membership in III would not be independent measures, since the 
former automatically precludes the latter.) 


10. Robustness Are the pertinent measures robust in scope? (Averages are not robust because 
they fail to capture the underlying variability in data; quantile measures may be 
preferred since they provide a better understanding of inherent variability.) 


11. Completeness Do the selected measures cover the range of data quality issues? 
RQI measures structure 


After considerable research and analysis, SDC determined that the RQI for a particular state 
should be a function of: (a) a set of outcome measures; (b) a timeliness measure; and (c) a 
completeness measure. In mathematical terms, then, the RQI takes the following form: 


1. RQI(s) = K*O(s)*P2(s)/P(s) 


where, 
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e O(s) is a weighted sum of N outcome measures, O(s) = [a,O;(s) + 
a2O2(s) +...+ anOn(s)]; 0 < Oi(s) < 1; currently, N = 10 and aj = 1/N 
for i = 1,2,...,N. 


e P,(s) is a normalized and censored process measure that reflects the 
average elapsed time between arrest and final disposition for all arrests 
that can be linked to at least one disposition for state s; P,(s) > 0, and 
P,(s) has no upper limit; thus RQI(s) is unbounded. 


e P»(s) is a disposition-based process measure that reflects the “cohort” 
completeness of records (e.g., the fraction of 1991 arrests that have 
posted final dispositions by the end of 1993). 


e kK is an appropriate scaling factor; currently, K = 100,000. 


e The underlying outcome and process measures of the RQI collectively 
satisfy to a large extent, the seven identified criteria. 


2. The national RQI, NRQI, is a weighted average of the individual state RQIs, 
where the weights are reflective of the number of criminal history records in each 
state. Thus, the NRQI is of the form: 


NRQI = w(1)*RQI(1) + w(2)*RQI(2) + w(3)*RQI(3) +...+ w(53)*RQI(S3) 


where, w(s) = weight of state s = ratio of number of criminal history records in 
state s to number of records nationwide; currently, s = 53. 


The RQI(s) is sensitive to changes in O(s), Pi(s), and P2(s) (Exhibit 3). Since RQI(s) is 
proportional or linear with respect to both O(s) and P»(s), a 20% increase, for example, in a 
state’s O(s) or P2(s), leads to a corresponding 20% increase in its RQI(s)*. On the other 
hand, RQI(s) is inversely proportional to P;(s) so a 20% decrease in a state’s P;(s) results ina 
25% increase in its Ral’. Finally, it is worth noting that the inclusion of additional measures 
in the RQI serves not only to better define the RQI but also to differentiate among the 
computed state RQIs. 


> To see how RQI(s) changes as P.(s) changes, suppose that state s has an initial RQI(s), called RQI’, based on 
an initial P,(s), called P2*. Now suppose that the value of P,"changes by x% to yield P,”. Then, p,? = 
(1+.01x)P,*. The percent change in the RQI is given by: 100*[RQI” — RQI’/RQI? = 100*[P”— P,*]/P2? = 
100*[(1+.01x)P,° — P,"//P*= 100*[(1+.01x) — 1] = x. Similarly, RQI(s) is linearly impacted by changes in 
O(s). Thus, a 20% increase in P2(s) (i-e., x = 20) results in a 20% increase in RQI(s). 

“ To see how RQI(s) changes as P,(s) changes, suppose that state s has an initial RQI(s), say RQI’, based on an 
initial P,(s), say P,°. Now suppose that the value of P,* changes by x% to yield P,”. Then, P,° = (1+.01x)P,’. 
Since RQI(s) is inversely proportional to P,(s), the percent change in the RQI is given by: 100*[RQI? — 
RQLEV/RQL = 100*[(1/P,”) — (1/P;°)/(1/P,) = 100* P,? [(1/P,”) — (1/P,)] = 100*[(P,°/P,”) — (P,°/P,”)] = 
100*(P,° — P,P,” = 100*[P,*— (1+.01x)P,°V/(1+.01x)P;° = 100*[1 — (1+.01x)]/(1+.01x) = 100*[- 
.01x/(1+.01x)] = — x/(1+.01x). Thus, a 20% decrease in P;(s) (i-e., x = —20) results in a 25% increase in RQI(s) 
(i-e., [— (-20)/(1-.01*20)] = [20/(1-.2)] = (20/.8) = 25). 
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Exhibit 3 RQI Sensitivity to O(s), Pi(s) and P2(s) 


RQI(s) = K*O(s)*P>(s)/P;(s) 


RQ\(s) is inversely 
proportional to P,(s) 


RQ\(s) is proportional to 
O(s), P2(s) 


Percent Change in RQI(s) 


-20% 
-40% 
-60% 
~ Ry ss Rs ° oe xs 3 is ele gle ase wo? 3 os oe oss ro ss oe oe 


Percent Change in Measure 


RQI outcome measures 


To begin the selection of RQI measures, SDC conducted an extensive literature review of 
existing records quality measures, including those identified by SEARCH, REJIS, BJS (i.e., 
National Judicial Reporting Program) and NCSC (i.e., Court Statistics Project). It turned out, 
however, that most of the measures cited in the literature were either not basic or not 
sufficiently pertinent to the RQI. Moreover, while the focus of the RQI is on data quality, 
virtually all published public-sector performance measures are budget-focused. For this 
reason, SDC defined an initial set of outcome measures, and worked closely over several 
months with BJS and with ten representative pilot test states — California, Georgia, Maryland, 
Minnesota, Missouri, New Jersey, North Carolina, Oregon, Texas, and Virginia — to better 
define and refine the measures. Ultimately, ten (10) outcome measures were identified. 
Exhibit 4 identifies each measure, describes how it is computed, and specifies the basic state 
data required. 
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Exhibit 4 RQI Outcome Measures 


RQI Measure 
‘What proportion of the records in your criminal history database 
are fully automated —i.e., records for which the master name 
index and entire criminal history are automated? 
‘What proportion of your criminal history records in III are 
indexed with SIDs (State IDentification Numbers) pointing to 
your state —i.e., the number of records for which your state 


Scoring Schema 
Decimal fraction of criminal history records which are fully 


automated 


III participant = decimal fraction of III records for which state is 


responsible; 
Non III participant = 0.0 


Required Basic Data 
Number of manual and automated records; 
number of fully automated records 


State's III status; number of persons with 
criminal records in state's III; number of records 
for which state is responsible 


responds to III inquiries? 


O;(s) |What proportion of your arrests — including both fingerprints and 
arrest information — are communicated to the repository via an 
automated interface? 

Note: Neither faxed transmissions nor data received via livescan, 
printed out and entered qualifies as automated. 

O,(s) |Does your criminal history database flag subjects with 
convictions for: 

a. Felony offenses? 

b. Domestic violence misdemeanors? 

c. Sex offenses? 

d. Child abuse offenses? 

e. Elderly abuse offenses? 


f. Disabled abuse offenses? 


Decimal fraction of annual arrests reported via an automated 
interface to repository 


Number of reported annual arrests; number 
reported via an automated interface 


Sum of scores: 

(0.4)/Most (0.3)/About Half (0.2)/Some (0.1)/None (0.0) 
(0.2)/Most (0.15)/About Half (0.1)/Some (0.05)/None (0.0) 
(0.1)/Most (0.07)/About Half (0.05)/Some (0.03)/None (0.0) 
(0.1)/Most (0.07)/About Half (0.05)/Some (0.03)/None (0.0) 
(0.1)/Most (0.07)/About Half (0.05)/Some (0.03)/None (0.0) 
(0.1)/Most (0.07)/About Half (0.05)/Some (0.03)/None (0.0) 


Specification of flagged subjects in CCH 


O(s) What proportion of your criminal fingerprints submitted to the 


FBI are transmitted electronically to the FBI's [AFIS? 
O,(s) |What proportion of your applicant fingerprints submitted to the 
FBI are transmitted electronically to the FBI's [AFIS? 


Decimal fraction of annual criminal fingerprints submitted to the 


FBI that are transmitted electronically 


Number of criminal fingerprints submitted 
annually to the FBI; number transmitted 
electronically 

Decimal fraction of annual applicant fingerprints submitted to the 


FBI that are transmitted electronically 


Number of applicant fingerprints submitted 
annually to the FBI; number transmitted 
electronically 


O,(s) |Do you electronically submit data to the: 
a. National Protection Order File? 

b. National Sex Offender Registry? 

c. Mental Defectives/Commitments File? 
d. Controlled Substance Abuse File? 


e. Denied Persons File? (Point-of-Contact states only)? 


Sum of scores: 
‘OC States: 
(0.2)/Most (0.15)/About Half (0.1)/Some (0.05)/None (0.0) 
(0.4)/Most (0.3)/About Half (0.2)/Some (0.1)/None (0.0) 
(0.1)/Most (0.07)/About Half (0.05)/Some (0.03)/None (0.0) 
(0.1)/Most (0.07)/About Half (0.05)/Some (0.03)/None (0.0) 
(0.2)/Most (0.15)/About Half (0.1)/Some (0.05)/None (0.0) 


Specification of databases to which state 
contributes data 


For Non-POC States: 
(0.2)/Most (0.15)/About Hal 


f (0.1)/Some (0.05)/None (0.0) 
(0.4)/Most (0.3)/About Half (0.2)/Some (0.1)/None (0.0) 


(0.2)/Most (0.15)/About Half (0.1)/Some (0.05)/None (0.0) 


0.2)/Most (0.15)/About Hal 


f (0.1)/Some (0.05)/None (0.0 


Og(s) 


‘What proportion of the court dispositions reported to the 


Decimal fraction of court 


lispositions so reported and weighted by: 


repository are communicated via: 
a. An automated interface? 

b. Magnetic tape transfer? 

c. Other means (mail, fax etc.)? 
O,(s) |What proportion of the following state files do authorized users 
have direct automated access to: 

a. Protection orders? 

b. Sex offender registry? 

c. Mental health information relevant to firearms eligibility? 

d. Drug abuse information relevant to firearms eligibility? 


Number of court dispositions reported to 
a. Automated interface = 1.0 repository; number reported by each means 
b. Magnetic tape transfer = 0.5 


c. Other means = 0.0 


Sum of scores: 

(0.3)/Most (0.2)/About Half (0.15)/Some (0.1)/None (0.0) 
(0.3)/Most (0.2)/About Half (0.15)/Some (0.1)/None (0.0) 
(0.2)/Most (0.15)/About Half (0.1)/Some (0.05)/None (0.0) 
(0.2)/Most (0.15)/About Half (0.1)/Some (0.05)/None (0.0) 


Specification of databases accessed 


Ox0(s) 


a. Is your state an NFF state? 
b. Has your state signed the National Crime Prevention and 


Sum of scores: 
a. NFF = 0.75 


Specification of whether state is NFF and/or 
Compact signed 


Privacy Compact? b. Signed = 0.25 


RQI process measures 


Process measures reflect a criminal history records system’s actual performance in terms of, 
say, timeliness and completeness. They can identify symptoms, not necessarily underlying 
causes, of data quality problems; thus, poor arrest/disposition linkage is usually a symptom 
of a structural problem (e.g., pertinent tracking numbers have not been entered on the 
arrest/disposition record). 


Timeliness measure, P;(s) 


An appropriate timeliness measure is the average time from arrest to final disposition posting 
in the Computerized Criminal History (CCH) in, say, a three-year period. Since states have 
different mandates as to which arrests must be submitted to their repositories, to obtain 
comparable data from state-to-state it would be desirable to restrict the arrests to felonies 
only, which are more consistently defined. For comparability, data should be collected based 
on calendar, rather than fiscal, years. 
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During the pilot phase of RQI development, SDC learned several lessons which framed the 
formulation of P;(s). First, not all states are able to distinguish felonies from misdemeanors; 
as a consequence, P;(s) would have to include misdemeanor, as well as felony, arrests. 


Second, although measuring the average elapsed time from arrest to disposition posting in the 
CCH, rather than disposition rendering, is very desirable, SDC discovered during the pilot 
test that reliable basic data on which to base time from disposition to posting is not usually 
available — pilot state CCHs do not capture time of posting or time of receipt of disposition. 
As aresult, SDC has been developing a model-based approach to estimating posting times 
from multiple CCH snapshots and is looking into which state CCHs, if any, have posting 
dates which can be used to validate the developed model. 


Third, arrests for which there is no disposition in the record pose a special problem. 
Although this could be due to missing data or an undisposed and/or unlinked case, from the 
user’s point of view it doesn’t matter since in either case the arrest is missing a linked 
disposition. For the purpose of the RQI, this means that in analyzing the elapsed time from 
arrest to disposition for arrests occurring in the three-year period 1995-1997, some arrests 
may not be finally disposed until after 1997, i.e., outside of the specified time period. The 
result is that the last three-year period for which the RQI is being computed in any data 
collection cycle would have an abbreviated average elapsed time from arrest to disposition, 
since no disposition dates would be known after the time period. To control for this, SDC 
censored the data; that is, to maintain period-to-period consistency, SDC treated an arrest 
whose disposition occurred after a specific three-year period as though the disposition 
occurred on the last day of the three-year period. An example of censoring P;(s) for 1997 
illustrates the concept (Exhibit 5). 


Exhibit 5 Example of Data Censoring for Computing P;(s) 


Data Uncensored Data Censored at End of 3- Year Period 


Arrest #1 to Disposition #1 


Arrest #1: No Posted Final Disposition 


est #2 to Disposition #2 


Arrest #3|to Disposition #3 


Arrest #2 to Disposition #2 


Arrest #3 to Disposition #3 


1995 1996 1997 1995 1996 1997 


Fourth, the CCH data that SDC acquired from the ten pilot states showed that, in general, 
there is a steady growth in arrest — and therefore disposition — volumes over time (Exhibit 6). 
High arrest volumes usually lead to court congestion which adversely impacts raw elapsed 
times from arrest to disposition. To control for the arrest volume variability over time, SDC 
normalized (i.e., divided) the average elapsed times by a volume-related factor. An 
appropriate normalizing factor is the ratio of the arrest volume in the measurement three-year 
period to the arrest volume in the base, or initial, three-year period (which BJS and SDC 
agreed would be 1991-1993). 


Therefore, the arrest-based process measure P;(s) can be defined as follows: 
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e P,(s) is a normalized and censored process measure that reflects the average elapsed 
time between arrest and rendered final disposition for all arrests that can be linked to 
at least one disposition for state s; P;(s) > 0 and P;(s) has no upper limit; P;(s) for 
year N reflects arrests occurring in the three years; N, N-1, and N-2. 


As a hypothetical example, suppose one wants to compute P;(s) for state s for 1997. Further, 
suppose that, based on the state’s arrest and disposition dates, the average time between an 
arrest and its rendered final disposition for arrests occurring in the 1995-1997 period is 
computed to be 173 days. If the arrest volume in 1995-1997 (i.e., the measurement period) is 
88,319 and the arrest volume in 1991-1993 (i.e., the base period) is 57,752, then the 
normalizing factor is 88,319/57,752 = 1.53. So for 1997, Pi(s) = 173 days/1.53 = 113.1 days. 
In other words, the value of P;(s) before normalization is 173 days while the value of Pi(s) 
after normalization is 113 days. P;(s), before and after normalization respectively, is 
illustrated (Exhibit 7). 


Exhibit 6 Arrest Volumes By Year For Pilot States 
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Exhibit 7 P(s) Before and After Normalizing For a Pilot State 
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Completeness measure, P2(s) 


Traditionally, completeness has been thought of in terms of a “snapshot” of the record 
repository, i.e., what fraction, as of a specific date, of all arrests in the repository has 
dispositions? A more meaningful approach to measuring completeness is to consider a 
cohort of arrests; i.e., arrests made in the same time period. With this in mind, SDC defined 
the process measure, P»(s), as follows: 


e P,(s) is a disposition-based process measure that reflects the “cohort” completeness of 
records. For year N, P2(s) reflects the fraction of calendar year N-2 arrest records that 
have final dispositions rendered and posted in the repository database by the end of 
calendar year N. 


An example of P2(s) for 1997 is shown (Exhibit 8); in this trivial example, P2(s) = 2/3 = 0.67. 
Specifically, the computation of P2(s) is based on the same CCH data extract of arrest and 
corresponding disposition dates SDC utilizes to compute P;(s). As an example, suppose one 
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wants to measure P>2(s) for 1997 and, based on the state’s CCH data, the number of 1995 
arrests is 90,077 and the number of 1995 arrests that have posted final dispositions by the end 
of 1997 is 68,123. Then P2(s) = 68,123/90,077 = 0.756. 


Exhibit 8 Example of P»(s) 


| 1995 Arrest #1: No Posted Final Disposition at End of 1997 


1995 Arrest #2 to 
Disposition #2 


1995 Arrest #3 to Disposition #3 


1995 1996 1997 
RQI process measures—required data 


To compute P;(s) and P.(s), each state was asked to create an extract of its CCH containing 
just two data fields: (i) date of arrest and (ii) date of final disposition, for all arrests reported 
in the 11-year period from January 1, 1991 through December 31, 2001. The start date was 
chosen to capture data from the period just preceding the NCHIP grant awards. SDC will 
collect data on an annual basis after 2001; thus, contributing to an RQI time series for each 
state. For RQI purposes, an arrest is considered to be “finally disposed” when at least one 
charge has a final disposition. If no final disposition is available, SDC asked the state to 
leave the field blank. If the state’s criminal history records had not yet been automated in 
January 1991, the state created the extract beginning with the date on which they were first 
automated. If the state tracked individual charges, they substituted charges for arrests in the 
extract and notified SDC of the substitution. In this case, the data fields would become: (i) 
date of arrest charge and (ii) date of final disposition of arrest charge, if available. 


A number of interesting observations emerged from the pilot phase. First, in all pilot states, 
the distribution of elapsed time from arrest to disposition is nearly exponential; in fact, the 
Weibull distribution is an excellent approximation (Exhibit 9) based on the chi-square 
goodness-of-fit test. Second, in several pilot states, the disposition date precedes the arrest 
date in as many as 1% of all arrests; a data entry error probably occurred in these cases. For 
a given state, the percentage of such errors is fairly consistent from year to year. Third, the 
percentage of undisposed arrests for a given year ranges from 5% to 45%. With only one 
exception, the percentages are fairly consistent for each state from year to year. 
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Exhibit 9 Distribution of Elapsed Time From Arrest To Disposition 
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How is the RQI being implemented? 


To minimize the information reporting burden on the states and to facilitate efficient data 
collection, SDC developed a Web-based instrument accessible on a password-protected 
basis. (A sample RQI Web form may be viewed at www.sdcorp.net/RQI/SampleForm.jsp.) 
Each state was issued a user ID and password; to assist in completing the form, every 
question had a “pop-up box” containing instructions for providing the data. States were also 
given the option to download the helpful PDF file of “Frequently Asked RQI Questions”. 
Additionally, the form was designed to accept partial submissions, retaining all pre-existing 
entries each time it is re-opened. States provided outcome measures data for 1993, 1997 and 
2001 only; as noted earlier, in future years, data will be furnished on an annual basis so as to 
create an RQI time series for each state. Additionally, states furnished the CCH data extracts 
necessary to compute P;(s) and P2(s) on a CD-ROM. 


As expected, not all the data SDC requested were available; for example, some states track a 
requested measure now but did not in the past or do not know what practice was followed in 
previous years. In other instances, some states track a requested measure but the data are 
reported as “not known”. Still, at other times, a state may never have tracked a requested 
measure. 


In a data collection effort of this magnitude, data irregularities are to be expected. In all 
states, it was necessary to “clean out” data anomalies (e.g., a disposition date which precedes 
its corresponding arrest date) from the CCH extract. As noted earlier, it was also necessary 
to normalize P;(s) to control for arrest volume variability and censor P;(s) for consistency 
from period to period. SDC resolved data anomalies, such as incomplete datasets, on an 
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individual state basis by using statistically appropriate techniques such as estimation or 
sampling. For example, one state provided a sample of arrests and dispositions when it was 
determined that their underlying CCH data file was unusable. They did this by filtering out 
records where one or both dates was known to be flawed and including only those records in 
which both the arrest date and final disposition date were deemed reliable. In another state, a 
programmer had accidentally deleted a number of known disposition dates from the CCH. 
Instead of the dates, the affected records contain “flags” indicating that a disposition date 
exists. These appeared to be random but were never recovered because the state knows the 
disposition outcome and reasoned that if anyone needed the date, it could be obtained 
directly from the court. Since SDC had no reason to believe that there was a systematic bias 
in these unknown dates, P;(s) was as usual computed utilizing those records with dates and 
ignoring those with flags only. Three other examples of potentially problematic datasets are 
presented (Exhibit 10). In each case, careful consideration of the data was required and a 
discussion of the problem with state officials at the repository and/or courts resulted in a 
satisfactory resolution. 


State 


Exhibit 10 Examples of Data Problems and their Resolution 


Data Problem 
How to calculate P,(A) and P(A) prior to 
2000 


How to calculate P,(B) and P,(B) 


How to calculate P;(C) and P.(C) 


Explanation Resolution 
State A's legacy CCH, in use until January 2000, |State A gave us 3 fields for the 1990-1999 data: 1. date 
did not store disposition dates as a separate field. of arrest; 2. date of disposition if it's a legacy arrest with 
The dates, if they were in the database at all, were |a disposition received after 1/1/2000; or 3. the free text 
embedded in a free text field, making it difficult to |legacy disposition field (which may or may not include 
extract them. the date). Upon receipt of data, SDC extracted the 
disposition dates wherever possible and examined the 
data closely to determine whether P,(A) and P(A) can 
be estimated using SDC's developed simulation model. 


State B's CCH does not track disposition dates. An official from Prosecution provided an extract from 
Upon reviewing a court data dictionary, SDC their database since it has both arrest and disposition 
discovered that both the arrest date and dispositon |dates. 

date are in the court records and, at first, SDC 

thought that using the court records would solve 

the problem. However, it turns out that the courts 

have the disposition date but do not have most of 

the arrest dates. The repository's arrest dates and 

the court's disposition dates could be linked via a 

State Transaction Number (STN), but only since 

July 2002 when the STN was implemented. 


State C's State Police was unable to provide the After talking to State Police and learning the extent to 
CCH data extract as SDC defined it because of which many disposition dates (i.e., the ones that come 
inherent database problems. The repository does from Corrections) are unreliable, SDC decided to work 
not regularly obtain dispositions from the courts; | with a sample of data (from 1/1/91-12/31/01) to 


rather, it obtains disposition data from the compute P,(C) and agreed to have them send: 
Corrections Department from which it creates new |1) Every record in which both the arrest date and final 
“dummy” arrests. With the aid of several C++ disposition date both are reliable (i.e., the dispos 
programs, they can build a RAP sheet, but the originate from the court). They intentionally filter out 


underlying data file is unusable, i.e., they cannot —_|records where one or both dates is known to be bad. 
use these programs to filter data sets for SDC This |[This is for computing the elapsed time - numerator of 


problem prevents State C's Repository from process measure P,]; 
generating statistical reports, a situation they have }2) A straight count, by year, of the total number of 
been attempting to rectify for a long time. arrests (or total final dispositions). They sent SDC the 


total number of arrests which is used for normalizing 
P,(C). SDC is working on P,(C); simulation may be the 
only approach. 


To aid in the modeling, validation, and testing of the RQI, SDC also developed a computer 
simulation model. Specifically, this model can be used to test for consistency in elapsed time 
Statistics by comparing simulation-generated times to empirically observed times. Thus, it 
can be used to estimate P;(s) and P2(s) when sufficient underlying data are unavailable and to 
estimate posting dates when they are unavailable. The simulation model also serves to 
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identify records system congestion points and linkages to appropriate improvement activities, 
a key RQI goal. 


What are some preliminary RQI findings? 


The 1993, 1997 and 2001 results for the first RQI data collection cycle are presented (Exhibit 
11). The importance of comparing the results from year to year within a state, rather than 
across states, cannot be overemphasized. This is because not all states collect and report data 
in an identical manner and, most importantly, the purpose of the RQI is to observe the 
progress of records improvement within each state. 
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Exhibit 11 RQI Results For 1993, 1997 and 2001 


State, s 
(N=53) RQI(s) 
Alabama 8 
Alaska 339 
Arizona 211 
Arkansas 90 
California 89 
Colorado 21 
Connecticut 296 
Delaware 533 
District of Columbia’ - 
Florida 170 
Georgia 234 
Guam 227 
Hawaii 192 
daho 316 
llinois 110 
ndiana 25 
‘owa’ -- 
ansas 14 
entucky’ - 
Louisiana’ - 
Maine’ -- 
Maryland 258 
Massachusetts’ a 
Michigan 483 
Minnesota 145 
Mississippi° or 
Missouri 90 
Montana” -- 
Nebraska 185 
Nevada 18 
New Hampshire 176 
New Jersey 238 
New Mexico* = 
New York 276 
North Carolina 675 
North Dakota 418 
Ohio 45 
Oklahoma 55 
Oregon* me 
Pennsylvania 124 
Puerto Rico 68 
Rhode Island 24 
South Carolina 97 
South Dakota 174 
Tennessee 567 
Texas 242 
Utah 181 
‘Vermont 785 
Virginia 458 
Washington 114 
West Virginia’ = 
Wisconsin 247 
Wyoming 114 
Weighted Average” 202 
N 42 
Notes: 


1. The RQI could not be computed because SDC has not yet received all da 


2. In Louisiana's and Montana's CCH data, the disposition dates were part of a free-text field. SDC is developing an algorithm 


to extract the dates, so that the respective P,, P, and RQI can be computed. 
3. RQI(MS) cannot be computed -- there was no central repository prior to 


998 and hence virtually no CCH data prior to 


that date which could be used to calculate P,(MS) and P,(MS). RQI(MS) cannot be calculated for 2001 since the disposition 
data is spotty -- the state has been focusing on entering arrest data and has a sizable disposition backlog. In future RQI cycles, 
there should be enough data on which to base the measures since MS is undertaking a project to reduce the disposition 


backlog. 


4. RQI(NM) and RQI(OR) cannot be calculated because P,(NM) and P.(OR) are problematic. In New Mexico, SDC obtained 
relevant data from Prosecution -- which in turn acquired the data only from counties which were automated. Thus, the data is 
limited. In Oregon, many dispositon dates are missing. SDC is working with Oregon to resolve the issue which may require 
simulation. There is no problem computing P,;(NM) and P,(OR) since SDC employed a representative sample. 

5. Average is weighted by the proportion of criminal history records in each state; the weighted RQI(s) is the NRQI. 


The Records Quality Index (RQI) 17 


This document is a research report submitted to the U.S. Department of Justice. This report has not 
been published by the Department. Opinions or points of view expressed are those of the author(s) 
and do not necessarily reflect the official position or policies of the U.S. Department of Justice. 


As one might expect, O(s) increases over time. In ten states, O(s) = 0 in 1993. This is due 
largely to the fact that most of the 1993 outcome measures in these states are zero; in some 
cases, a few are simply unavailable. By 1997, O(s) = 0 in only two states. 


The computed state RQI cannot be less than zero and has no upper limit. For 1993, the RQI 
ranged from 0 to 234 (with a median of 35.4); for 1997, the RQI ranged from 0 to 338 (with a 
median of 112.2); and for 2001, the RQI ranged from 8 to 785 (with a median of 178.6). One 
expects the RQIs to increase over time as states make improvements to their criminal history 
records systems. (By definition, half the states had larger RQIs than the median and half the 
states had smaller RQIs.) 


From 1993 to 1997, the median percent RQI increase was 78.5%; from 1997 to 2001, the 
median percent RQI increase was 77%. Over time, one expects the median percent increase 
in the RQI to diminish. 


Naturally, states with an RQI of zero have considerable room for improvement. It is 
noteworthy that in 1993 there were eleven such states, whereas in 1997 there were only two 
and in 2001 there was none. 


With few exceptions — due primarily to large arrest fingerprint card and/or disposition 
backlogs at the repository — the state RQIs increased over time. To better understand the 
exceptions, SDC plotted the distributions of the arrest data and the disposition data in these 
states and observed that: 


e In Alabama, the arrest volume increased while dispositions dipped sharply for 1999 
arrests, then rebounded for 2000 arrests — the state conjectured that this was due to the 
fact that a large number of dispositions for 1999 arrests had not been entered in the 
CCH. After entering the dispositions, the state re-extracted the data and SDC 
determined that this was in fact the case. 


e In Nevada, the arrest volume increased while the disposition volume decreased; this 
is because the repository has a large, growing disposition backlog with insufficient 
manpower to enter the dispositions in the CCH. 


e In Puerto Rico, the arrest volume was steadily increasing until 1999 when it dropped 
substantially and continued to fall through 2001. The drop is attributable to an arrest 
backlog at the repository. This caused a dramatic rise in P; which in turn resulted in 
RQI(PR) falling off. 


e In Rhode Island, the arrest volume declined between 1991 and 1998 and then rose 
sharply. The decline was a result of an arrest backlog at the repository. 


e In Wyoming, the repository confirmed that an atypical decrease in arrest volumes in 
2000-2001 was due to an arrest fingerprint backlog. 


In the course of analyzing the measures data, it is imperative to remain in contact with state 
repository officials and information analysts since their familiarity with the data helps to 
explain anomalies. In addition to the examples cited above, several interesting results 
emerged from Vermont’s data. For example, the state’s Po(VT) — which isa reflection of the 
level of disposition reporting and linkage — was nearly perfect (i.e., 98.4%) in 2001. This can 
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be attributed to the fact that Vermont has a criminal history records systems that is 
arraignment-based, i.e., criminal records originate in the courts, rather than with law 
enforcement at the time of arrest. This arrangement is very effective for arrest-to-disposition 
linkage purposes. According to Vermont officials, the state enjoyed high linkage levels even 
when it was one of the least-automated states, suggesting that while automation greatly 
improves timeliness, it is not essential to improving completeness, i.e., disposition reporting 
and linking. (It turns out, however, that arraignment-based records are problematic with 
respect to fingerprint-support. Vermont’s records, which largely fall into this category and 
are thus ineligible for entry in the Interstate Identification Index (III), are slated for the 
National Instant Background Check System (NICS) Index of Denied Persons File.) Vermont 
also has a very low P;(VT) — 34 days in 1997 and 22 days in 2001. This is reportedly due to 
the fact that many people plead guilty at arraignment, thus avoiding an oft-delayed court trial 
and keeping the time between arrest and final disposition short. An extremely low Pi(VT) 
coupled with a very high P2(VT) explains Vermont’s high RQI (i.e., 785) in 2001, and is 
consistent with the RQI’s sensitivity to its constituent measures, as demonstrated in Exhibit 
3. 


The last row of Exhibit 11 shows the weighted averages of the O(s), P1(s), Po(s) and RQI(s), 
respectively. Each state measure is weighted by the state’s proportion of all criminal history 
records to obtain its “weighted average” and is discussed below. 


Outcome measures 

Regarding O(s), its weighted average nearly tripled between 1993 and 2001. The distribution 
of state responses to three outcome measures, Oz, O7 and Os, is shown in Exhibit 12. 
Respondents selected from a drop-down menu of five possible choices regarding records in 


their state: “All,” “Most,” “About Half,” “Some”, “None,” and “Don’t Know”. 


Exhibit 12 Distribution of State Responses to Outcome Measures O4, O7, Og 


1993 (N = 51) 1997 (N = 51) 2001 (N= 51) 
About Don't About Don't About Don't 
Questions All Most Half Some None Know} All Most Half Some None Know} All Most Half Some None Know 

Oy. In the indicated year, did your state's 
criminal history database flag subjects with 
convictions for: 
a. Felony offenses? 38% 2% 2% 4% 42% 12% | 52% 8% 2% 6% 27% 6% 62% 10% 0% 8% 15% 6% 
b. Domestic violence misdemeanors? 4% 0% 0% 2% 85% 10% | 17% 4% 2% 4% 65% 8% 31% 8% 0% 2% 56% 4% 
c. Sex offenses? 6% 0% 0% 4% 83% 8% 21% 6% 0% 15% 50% 8% 31% 13% 0% 10% 42% 4% 
d. Child abuse offenses? 4% 0% 0% 2% 87% 8% 6% 2% 0% 2% 83% 8% 6% 4% 0% 4% 81% 6% 
e. Elder abuse offenses? 2% 0% 0% 2% 87% 10% 4% 0% 0% 2% 87% 8% 4% 0% 0% 2% 87% 8% 
f. Disabled abuse offenses? 2% 0% 0% 2% 88% 8% 2% 0% 0% 2% 88% 8% 0% 0% 0% 2% 90% 8% 
O,. In the indicated year, did your state 
electronically submit data to: 
a. National Protection Order File? - - - - - - 13% 0% 2% 8% 69% 8% | 44% 2% 0% 8% 40% 6% 
b. National Sex Offender Registry? - - - - -- - - - - - - - 50% 6% 0% 13% 25% 6% 
c. Mental Defectives/Commitments File? - - - - - - - - - - - - 2% 0% 0% 2% 81% 15% 
d. Controlled Substance Abuse File? - - - - - - - - - - - - 0% 0% 0% 2% 79% 19% 
cae Person 's File (Point-of-Contact states 6% 0% 0% 4% 65% 25% 


Og. In the indicated year, what fraction of the 
following state files did authorized users have 
direct automated access to: 


a. Protection order? 17% 0% 0% 0% 63% 19% | 46% 2% 2% 2% 35% 13% | 63% 4% 0% 6% 17% 10% 

b. Sex offender registry? 12% 0% 0% 2% 71% 15% | 42% 4% 2% 10% 27% 15% | 67% 6% 0% 8% 10% 10% 
gistry 

. Mental health information relevant to fi 

enalilge eat Information retevant {0 NFEATMST 9% 0% += 0% ~—S« 2% ~—B1% ~—«15% | 10% 0% 0% 6% 71% 13% | 17% 0% 0% 8% 63% 12% 

d. Drug abuse information relevant to fi 

amie Information retevanr to trearms 1 6% 2% 0% 0% 69% 23% | 8% 2% 0% 4% 63% 23% | 10% 2% 0% 6% 60% 23% 
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Regarding measure Oy, — flagging of subjects with specific types of convictions — felony 
flagging is the most prevalent across all measured years; this is likely due to the fact that 
felony flagging has been a federal priority since the late 1980s whereas the other federal flag 
setting requirements were imposed more recently. Subjects with domestic violence 
misdemeanors and sex offenses are being flagged more conscientiously but much work 
remains to be done; almost one-third of the responding states are now flagging all subjects 
with these two categories of records. Flagging of child, elder and disabled abuse, lag far 
behind. In the event that new federal priorities mandate flagging subjects with yet other 
types of offenses, SDC will incorporate them in the RQI. 


Measure O; is not relevant in 1993 and is only relevant in 1997 for the National Protection 
Order File (NPOF), since the other files did not exist prior to that date. Between 1997 and 
2001, the fraction of states submitting all their data electronically to the NPOF more than 
tripled (from 13% to 44%). In 2001, 69% of all states were submitting at least some data 
electronically to the National Sex Offender Registry (NSOR) — 50% were transmitting all 
data automatically. Populating the NPOF, the Mental Defectives, the Controlled Substance 
Abuses, and the Denied Persons Files (DPF) is especially important because these files are 
checked to determine whether a person is ineligible to purchase a firearm; the last three files 
are not so well populated as the NPOF and the NSOR. The DPF is especially helpful: Not 
only does this file contain names of individuals who have been previously denied a firearm, 
but it also contains disqualifying records that are not in other federal files used to determine 
firearm eligibility, such as the Interstate Identification Index (III) of criminal records, the 
National Crime Information Center (NCIC) files of warrants and “hot” files, and the NICS 
Index of non-criminal records. The DPF includes persons denied for misdemeanor crimes of 
domestic violence, warrants that do not meet criteria for entry in NCIC, active protection 
orders not available in NCIC, and criminal history records not supported by fingerprints. 


Direct automated access to state protection order and sex offender registry files has increased 
dramatically since 1993 (measure Oo), so that in 2001 approximately two-thirds of the states 
responded that all records in both files could be accessed automatically. Automated access to 
mental health and drug abuse information lag behind substantially (17% and 10%, 
respectively). 


Process measures 
To gauge how the nation is performing in regard to timeliness and completeness of records, 
one can compute the weighted averages of P;(s) and P2(s), respectively, for all states and 


chart their progress over time. 


Exhibit 13 depicts P;(ave), the national weighted average of the individual P;(s). In other 
words: 


Pi(ave) = w(1)*Pi(1) + w(2)*Pi(2) +...+ w(53)*Pi(53) 


where w(s) = weight of state s = ratio of number of criminal history records in state s 
to number of records nationwide; currently, s = 53. 
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As one might expect, P;(ave) decreases over time; in fact, it decreased substantially — by 
34% between 1993 and 2001, the first and last measured time periods — from 285 to 188 
days. Overall, the behavior of P;(ave) mirrors the behavior of the individual P;(s) and clearly 
suggests that strides are being made in reducing the average time between an arrest and its 
final disposition. 


Exhibit 13 P;(ave), Weighted Average of P;(s) 
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Exhibit 14 P,(ave), Weighted Average of P>2(s) 
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Similarly, Exhibit 14 illustrates P2(ave), the national weighted average of the individual 
P»(s). So: 


P»(ave) = w(1)*P2(1) + w(2)*P2(2) +...+ w(53)*P2(53) 


where w(s) = weight of state s = ratio of number of criminal history records in state s 
to number of records nationwide; currently, s = 53. 


In this case, P2(ave) initially increases and then declines beginning in 1997. To speculate 
why this might be occurring, it is important to understand that two phenomena impact 
P.(ave); first, the number of arrests for which there are final dispositions rendered by the end 
of a specified time period — for which SDC collected data — and, second, the rate at which 
dispositions are being reported to and posted in the repository — for which SDC was not able 
to collect data since disposition receipt and posting dates were not available. 


The behavior of P2(ave) may be attributable to disposition reporting. The significant jump 
(i.e., 8%) in Po(ave) between 1994 and 1995 could be due to the Criminal History Records 
Improvement (CHRI) program funds which were administered from FY 1990 through FY 
1993 and which emphasized automated disposition reporting. The gains in reporting level 
off and reach a steady state with the 1995 arrest cohort. The steady decline in P2(ave), 
starting with the 1997 arrest cohort, may be explained by the fact that it still takes a long time 
on average for dispositions to get into the repository; we should expect to see improvements 
in the 1997, 1998 and 1999 arrest cohorts in the future. By continuing to request annual 
extracts of the CCH data, SDC will gain a better understanding of the disposition reporting 
time frame. 


National Records Quality Index 


As noted earlier, the national RQI, NRQI — a measure of the overall performance of the 
nation’s criminal history records systems — is a weighted average of the individual state 
RQIs, where the weights are reflective of the number of criminal history records in each 
state. 


Thus, the NRQI is of the form: 
NRQI = w(1)*RQI(1) + w(2)*RQI(2) + w(3)*RQI(3) +...+w(53)*RQI(S3) 


where, w(s) = weight of state s = ratio of number of criminal history records in state s 
to number of records nationwide; currently, s = 53 


To illustrate how the NRQI is computed, assume that the “nation” consists only of six states; 
ie., s = {A, B, C, D, E, F}. Further, assume that the states’ RQIs, {RQI(s)}, the numbers of 
records (in thousands), and the weighting factors, {w(s)}, are as follows: 


RQI(A) = 61.9 # records in state A = 1,100 w(A) = 1,100/5,633 = 0.195 
RQI(B) = 49.8 # records in state B= 539 w(B) =  539/5,633 = 0.096 
RQI(C) = 40.4 # records in state C = 1,344 w(C) = 1,344/5,633 = 0.239 
RQI(D) = 54.5 # records in stateD = 815 w(D) = 815/5,633 = 0.145 
RQI(E) = 100.2 # records instateE= 627 W(E) = 627/5,633 = 0.111 
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RQI(F) = 92.7 # records in state F = 1,208 w(F) = 1,208/5,633 = 0.215 
Total = 5,633 


Then, a six-state NRQI would be given by: 


NRQI = 0.195*61.9 + 0.096*49.8 + 0.239*40.4 + 0.145*54.5 + 0.111*100.2 + 0.215*92.7 
= 65.5 


As shown graphically in Exhibit 15, between 1993 and 1997, the NRQI grew from 56.2 in 
1993 to 202.0 in 2001. With continued federal funding and its resulting improvements, we 
can expect to see the NRQI continue to grow in future years. The more effectively the 
funding targets areas of potential improvement, the more that improvement will raise the 
individual state RQI(s) and be reflected in the growth of the NRQI. 


Exhibit 15 National Records Quality Index (NRQI) 
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Relationship to records improvement activities 


During NCHIP’s predecessor effort, the CHRI program, SDC developed a taxonomy to 
classify and monitor the federally-funded criminal history records improvement activities and 
to facilitate data analysis. The taxonomy mirrors the functions of the criminal justice system 
in regard to in the creation, storage and dissemination of criminal history records and has 
become the comerstone of SDC’s national program evaluation. Over past funding cycles, it 
has been enhanced to accommodate new allowable improvement expenses and is now used 
to classify more than 3,500 activities. Exhibit 16 demonstrates the analytical power of the 
taxonomy: For each of the six major NCHIP goals, the progress in criminal history records 
improvement is brought to light by the cumulative number of states which have undertaken 
key goal-based activities over a period of 15 years (1990-2004). For example, 1997 saw the 
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rapid growth in states’ attempts to identify sex offenders, dovetailing with the introduction of 
National Sex Offender Registry (NSOR) program funds. 


Exhibit 16 Progress in Criminal History Records Improvement (1990-2004) — Key Goal- 
Related Activities 
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In relation to the RQI, SDC will use the taxonomy to link activities to changes in a state’s 
RQI — to ascertain which activities are most likely to yield the greatest increase in each 
state’s RQI. This will be accomplished by mapping the underlying RQI outcome and process 
measures to individual activities. 


What’s next? 


Over the past 18 months, SDC, in consultation with BJS, developed a robust RQI, pre-tested 
it in ten pilot states, and refined it accordingly. The first national data collection cycle has 
been successfully completed and state RQIs as well as the national RQIs for the years 1993, 
1997 and 2001 have been computed and reported herein. 


In forthcoming cycles, SDC will again obtain measures data and compute the annual state 
RQIs, as well as the national RQIs. Thus, each participating state and territory will have an 
associated RQI time series consisting of data points for 1993, 1994, 1995, etc. Based on the 
lessons learned during the first cycle, SDC will refine the underlying RQI measures, and add 
new measures as necessary to reflect new records improvement goals and corresponding 
federally-sponsored activities; of course, SDC will continue to track all state activities 
closely. To further streamline the data submission process, SDC will improve the Web- 
based data collection instrument by, for example, incorporating additional data edits. 
Perhaps the most significant enhancement to the next RQI cycles will be the development of 
a tool that will assist states to identify those activities eligible for federal funding which will 
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yield the greatest improvement in the measures that underpin their respective RQIs. This 
“State-Specific RQI Optimizer” (SSRO) will justify the process of selecting activities for 
improvement, thereby enabling the states to base their requests for federal funds on strategies 
that can potentially yield significant improvements in their RQIs; hence, quality 
improvements to their criminal history records. 
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